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ABSTRACT 


Background: An overlooked group for school health education advocacy training is college students enrolled in per¬ 
sonal health courses. They will be investors and stakeholders in the quality of public education, and the health and 
academic success of students. Purpose: In this article we present the process used to develop a theory-based instrument 
that can help to assess changes in intentions to advocate for school health education after exposure to an advocacy 
training intervention conducted with college students enrolled in personal health courses. The instrument constructs 
were developed based on Theory of Planned Behavior (TPB). Methods: Researchers used a comprehensive instrument 
design framework, involving the Standards for Educational and Psychological Testing and four stages of pretesting to 
develop and test the instrument items. A confirmatory factor analysis (CFA) was used to test the relationship among 
ordinal items in the Likert-type instrument and the constructs in TPB, which the items were developed to measure. 
Results: Fit indices for the structural model indicated that the proposed model provided a satisfactory fit for the 
data. Therefore, the final instrument consists of 53 items, measuring intentions of students to engage in school health 
education advocacy, as a result of implementing an advocacy-training lesson. Discussion: This study resulted in an 
instrument to measure the effectiveness of an advocacy-training lesson for college students that produces valid and 
reliable scores. Translation to Health Education Practice: The instrument development processes can be replicated 
by practitioners when creating surveys to administer in their respective populations. 

Chaney B, Wallen M, Birch DA. The development of an instrument to assess advocacy intentions for school health education. Am J Health Educ. 
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BACKGROUND 

School health educators have been en¬ 
couraged to “sell” health education to com¬ 
munity members, and to develop “health 
champions” in local school districts to 
advocate for school health education. 1,2 To 
meet the requisite responsibility to advocate 
for school health education, strategies for 
advocacy-related training have been devel¬ 
oped to prepare school health education 
undergraduate and graduate students. 3 ' 6 In 
addition to school health educators, com¬ 
munity members, elementary and secondary 
students, physicians, school board members 


and parents have been identified as potential 
advocates for school health education. 2,7 ' 9 

Birch, Wallen, and Chaney 7 propose 
another important group for school health 
education advocacy training that has previ¬ 
ously been overlooked - college students 
enrolled in personal health courses. Whereas 
no data exist, it can be safely speculated that 
thousands of students across the United 
States are enrolled in these courses each 
academic year. All of them will soon be 
members of local communities (with local 
school districts), and some will become par¬ 
ents. They will be investors and stakeholders 


in the quality of public education, and the 
health and academic success of students. 


Beth Chaney is an assistant professor in the 
Health Education Department, Room 5, FLG, 
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versity, Greenville, NC 27858. David A. Birch 
is a professor and Chair of the Department of 
Health Science, The University of Alabama, 
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We believe that this group is a conveniently, 
untapped source for providing school health 
education advocacy training. 

PURPOSE 

This paper presents the process used to 
develop a theory-based instrument that can be 
used to assess changes in intentions to advocate 
for school health education after exposure to 
an advocacy-training intervention. 

METHODS 

The instrument development process 
used in this study was theory-driven, and 
based on prior research assessing intentions 
to advocate for health and health education. 
Whereas McCrary-Quarles and colleagues 10 
have developed an instrument for assessing 
intent to advocate after exposure to advocacy 
training, their instrument was developed 
for evaluating training that targeted health 
educators with a primary focus on state-level 
advocacy. Content and face validity were 
confirmed by only two individuals. No con¬ 
firmation of construct validity was reported 
and no indication was provided of the ethnic 
and racial background of participants. The 
process used in the development of the in¬ 
strument described in this article includes 
a thorough, literature-based, step-by-step 
process. The product is an instrument 
intended to address non-health educators’ 
intentions to participate in local advocacy 
for school health education. 

Ajzen and Fishbein’s Theory of Planned 
Behavior (TPB) 11 asserts that “the most 
important determinant of behavior is 
behavioral intention.” 12(p70> Constructs to 
determine behavioral intention, include at¬ 
titude toward the behavior, subjective norm 
associated with the behavior, and perceived 
behavioral control. 12 The identified deter¬ 
minants of behavior in TPB provided the 
backdrop for item selection, modification, 
and construction. In addition, 12 items 
from the McCrary-Quarles and colleagues 10 
instrument (two measuring attitude, three 
measuring subjective norms, three mea¬ 
suring perceived behavioral control and 
four measuring intentions) for assessing 
intentions to participate in advocacy were 


selected for inclusion in the instrument. 
For the context of this instrument, school 
health education advocacy is the behav¬ 
ior of interest, and is defined in terms of 
engagement in varying types of advocacy 
activities (such as writing letters/e-mails to 
school board members, writing editorials, 
meeting with decision-makers, advocating 
for school health education through social 
networks) within a six-month timeframe. 
The following factors were assessed to mea¬ 
sure intentions to engage in the behavior of 
interest: (1) attitudes - measured by assess¬ 
ing students’ beliefs regarding outcomes of 
advocating for school health education, and 
their evaluations of those beliefs, (2) subjec¬ 
tive norms - measured by assessing students’ 
personal experiences and perceptions of 
various individuals’ influence on their mo¬ 
tivation to advocate for school health, and 
(3) perceived behavioral control - measured 
by assessing students’ perceptions of barriers 
or support for advocacy, and their ability to 
impact these control factors. 

The outlined test development process 13 
was used and adapted with Dillman’s 14 
four stages of pretesting to construct the 
instrument for the current study. 15 To initi¬ 
ate the instrument development process, a 
thorough literature search was conducted 
to identify items measuring the constructs 
intended for this study. 

Step 1 - Purpose of Instrument 

The first step of educational test con¬ 
struction is to expand the purpose of the 
test and the constructs (i.e., the concepts the 
instrument is developed to measure) into a 
framework that “describes the extent of the 
domain, or the scope of the construct to be 
measured.” 13(p37) Guided by the theoretical 
framework of TPB, 11 the overall purpose of 
the instrument for this study is to assess col¬ 
lege students’ intentions to engage in school 
health education advocacy, as a result of 
the implemented advocacy-training lesson. 
The determinants of behavioral intention 
(i.e., intention to advocate for school health 
education)—attitudes, subjective norms 
and perceived behavioral control—provide 
the framework for the instrument develop¬ 
ment process. 


Step 2 - Test Specifications 

Identifying the test specifications is Step 2 
in the instrument design process. According 
to the Standards, 13 “the test specifications 
delineate the format of items, tasks, or ques¬ 
tions; the response format or conditions 
for responding; and the type of scoring 
procedures.” 13(p3S) For the current study, the 
item formats include Likert scale and open- 
ended questions. This study instrument was 
developed in order to establish equality of 
testing measures and outcomes for partici¬ 
pants, regardless of gender, race, ethnicity, 
or any other characteristic. 13 

Step 3 - Development of a Pool of Items 

With TPB constructs as the guiding 
framework, items were selected, modified, 
and created for the instrument. Items from 
McCrary-Quarles and colleagues 10 instru¬ 
ment to assess intentions to advocate were 
utilized, and Dillman’s Tailored Design 
Method 14 was used to develop additional 
questions. The additional questions aimed 
to assess students’ intentions to participate 
in certain advocacy-related activities, such 
as attending a local school board meeting or 
e-mailing a school board member or admin¬ 
istrator regarding school health education. 
The final pool of items consisted of 53 items, 
including eight demographic questions. 

Step 4 - Dillman’s Four Stages of Pretesting 

Prior to subjecting the pool of items to 
Dillman’s four stages of pretesting, 14 ap¬ 
proval from the Institutional Review Board 
(IRB) at the University of Florida (UF) was 
sought and received. The following pretest¬ 
ing stages resulted in the final selection of 
items for the instrument and subsequent 
pilot test. The methods and results of the 
four pretesting stages are outlined below. 

Stage 1: Review by knowledgeable 
colleagues 

Methods. The compiled pool of items was 
reviewed by a panel of six experts, which 
consisted of professionals with expertise in 
the areas of survey development and health 
education advocacy. The primary goal of this 
stage was “to finalize the substantive content 
of the questionnaire so the construction 
process can be undertaken.” 14(pl41) The panel 


American Journal of Health Education — September/October 2011, Volume 42, No. 5 287 



2 - 

was also responsible for evaluating evidence 
of content-related bias and any apparent is¬ 
sues in the instrument. 

Results. Results of the panel review 
indicated that the chosen item formats 
of Likert scale and open-ended questions 
were appropriate for assessing the identi¬ 
fied constructs. Additionally, modifications 
were made to six questions, with regard to 
item wording. Two items were deleted, and 
three were added. Reorganization of items 
was suggested by multiple panel members; 
therefore, items were grouped by construct 
(i.e., attitude items together, subjective 
norm items together) and reformatted into 
multiple-part questions. For example, the 
first nine items measured attitudes toward 
school health education advocacy, and were 
renumbered 1 .a through 1 .i. In addition, the 
panel members agreed that items appeared 
to measure the identified constructs, and 
therefore, provided strong evidence of face 
and content validity. 

The suggested modifications by the panel 
members resulted in a 53-item instrument, 
which consisted of five multiple-part ques¬ 
tions and eight demographic questions. 
Question 1 (l.a.-l.i. - 8 Likert scaled items 
and 1 open-ended item) assessed attitudes 
toward school health education advocacy. 
Question 2 (2.a.-2.i. - 8 Likert scaled items 
and 1 open-ended item) measured students’ 
perceptions of normative beliefs regarding 
school health education advocacy, while 
Question 3 (3.a.-3.i. - 8 Likert scaled items 
and 1 open-ended item) assessed motiva¬ 
tion to comply with those beliefs. Question 4 
(4.a.-4.g. - 6 Likert scaled items and 1 open- 
ended item) measured control factor beliefs 
of the students, while question 5 (5.a.-5.e. - 4 
Likert scaled items and 1 open-ended item) 
measured students’ likelihood of engaging in 
various advocacy activities, despite identified 
control factors. Question 6 (6.a.-6.f.) assessed 
student perceptions of the effectiveness of 
the advocacy-training lesson in increasing 
awareness, interest, skills, understanding and 
intentions related to school health education 
advocacy. The final eight items were demo¬ 
graphic questions, including the assessment 
of prior advocacy skills. 
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Stage 2: Interviews to evaluate 
cognitive and motivational qualities 

Methods. Cognitive interviews were 
conducted with six undergraduate students 
at the University of Florida (UF). Students 
were recruited from an undergraduate 
course, offered within a Department of 
Health Education and Behavior. The students 
were asked the 53 items, individually, by an 
interviewer. The participants were asked to 
verbally respond to items, and to think out 
loud when responding to questions. For 
example, while reading the instructions out 
loud, respondents were asked to verbally 
state any thoughts that came to mind, such 
as “these are unclear” or “I understand what 
to do;” moreover, if respondents read a word 
they did not understand, they were advised 
to verbally address that thought with the 
interviewer. According to Dillman, 14 the in¬ 
terviewer “probes the respondents in order to 
get an understanding of how each question is 
being interpreted and whether the intent of 
each question is being realized.” 14(pl42) Cog¬ 
nitive interviewing “is designed to produce 
information when the respondent is confused 
or cannot answer a question.” 14(pl42) 

Results. Minor wording modifications 
to two items were made, as a result of the 
six cognitive interviews. No items were 
deleted or added and no formatting edits 
were suggested by respondents. Four of 
the six respondents noted the clarity in the 
instrument directions, and mentioned the 
importance of highlighting the purpose of 
the data collection tool. 

Stage 3: A pilot test 

Methods. The pilot test analyzed the in¬ 
strument to evaluate an advocacy-training 
lesson designed for college students in 
personal health classes. In April 2010, 89 
students enrolled in a personal health course 
at UF participated in a 50-minute advocacy¬ 
training lesson, and were administered the 
53-item instrument after the activity was 
conducted. The class instructor used the 
advocacy-training lesson and support¬ 
ing instructional materials, developed by 
Birch, Wallen, and Chaney 7 to conduct the 
50-minute lesson in the class. In addition to 
collecting the survey data from students, a 


one-on-one interview was conducted with 
the instructor of the course, to gain more 
insight into the instructor’s perspective of 
the advocacy-training lesson and survey 
administration procedures. Data collected 
from this first wave of pilot testing were ana¬ 
lyzed and used to improve the second wave 
of pilot testing. Reliability measures and 
frequencies for reporting on each construct 
were also assessed. 

Following the first wave of pilot testing 
in April 2010, the advocacy-training lesson 
and instrument were administered to two 
sections of a personal health course at UF 
in May 2010. In this pilot test phase, 195 
students participated in a one group pr el 
posttest design, implemented to assess dif¬ 
ferences of measured constructs after the 
implementation of the lesson. 

Construct validity has been described as 
“the results achieved from using the instru¬ 
ment predict those matters which the theory 
underlying the instrument’s design says they 
should predict.” 16(p82) For the purpose of as¬ 
sessing construct validity of the instrument, 
the first wave data (N = 89), collected in April 
2010, and the pretest data from the second 
wave (N = 195), collected in May 2010, were 
combined and subjected to a Confirmatory 
Factor Analysis (CFA) to assess if the data fit 
the proposed TPB framework. The samples 
were combined in order to achieve a large 
enough sample size to run the CFA analysis, 
as CFA is “often referred to as large sample 
[technique], reflecting the fact that perfor¬ 
mance can be enhanced with larger sample 
size” 17(p65> Additionally, reliability measures 
to assess the consistency of scores from items 
in the instrument were assessed. Cronbach’s 
coefficient alpha (a) was used to determine 
internal consistency reliability. 

RESULTS 

Wave I Results. Demographic analysis of 
the study sample was calculated using Pre¬ 
dictive Analytic Software (PASW) Version 
18.0. 18 For the first wave of the pilot test {N 
= 89), 32.6% were male, while the remain¬ 
ing 67.4% were female. Sixty-four percent 
indicated “white/Caucasian” for race, while 
22.1% were black/African American, Asian 


288 American Journal of Health Education —September/October 2011, Volume 42, No. 5 



Beth Chaney, Michele Wallen, and David A. Birch 



(7.0%), Native Hawaiian/Other Pacific Is¬ 
lander (1.2%), Other (4.7%). Approximately 
23% were Hispanic American. Of the 89 stu¬ 
dents in this wave, a majority were freshman 
(35.2%) and sophomore students (37.5%), 
and 11 UF colleges were represented, with 
the largest percentage of students (35.6%) 
being housed in the College of Public Health 
and Health Professions. 

To gain preliminary reliability measures 
of the scales, Cronbach’s alpha (a) was 
assessed for the wave I pilot data, using 
Predictive Analytic Software (PASW) Ver¬ 
sion 18.0. 18 For the items measuring at¬ 
titude toward advocacy (incorporating the 
behavioral belief and evaluation of those 
beliefs), the Cronbach’s a was 0.813. For the 
subjective norms scale (including normative 
belief and motivation to comply items), the 
Cronbach’s a was 0.782. Perceived behavior 
control items (incorporating factors that 
hinder or support advocacy) resulted in a 
Cronbach’s a of 0.831, while items measur¬ 
ing intention to conduct various advocacy 
activities had a Cronbach’s a of 0.866. 

Wave II Results. Demographic analysis 
of the study sample was calculated using 
Predictive Analytic Software (PASW) Ver¬ 
sion 18.0. 18 For wave II of the pilot test (N 
= 195), 23.6% were male, while the remain¬ 
ing 75.8% were female. Fifty-nine percent 
indicated “white/Caucasian” for race, while 
17.5% were black/African American, Asian 
(14.3%), Native Hawaiian/Other Pacific 
Islander (0.6%), Other (8.4). Approximately 
25% were Hispanic American. A majority 
of the sample were freshman (36.6%) and 
sophomore students (38.5%), and 11 UF 
colleges were represented, with the larg¬ 
est percentage of students (21.4%) being 
housed in the College of Health and Human 
Performance. When asked how students 
would rate their advocacy skills prior to 
enrolling in the course, 45.6% rated their 
skills “fair” on a 4-point Likert scale (1 = 
excellent to 4 = poor). 

Cronbach’s alpha was assessed for the 
wave II pilot data, using Predictive Analytic 
Software (PASW) Version 18.0. 18 For the 
items measuring attitude toward advocacy 
(incorporating the behavioral belief and 


evaluation of those beliefs), the Cronbach’s 
a was 0.799. For the subjective norms scale 
(including normative belief and motiva¬ 
tion to comply items), the Cronbach’s a 
was 0.861. Perceived behavior control items 
(incorporating factors that hinder or sup¬ 
port advocacy) resulted in a Cronbach’s a 
of 0.864, while items measuring intention 
to conduct various advocacy activities had 
a Cronbach’s a of 0.836. 

Construct Validity Measures 

A confirmatory factor analysis (CFA) was 
used to test the relationship among ordinal 
items in the Likert-type instrument and the 
constructs in TPB, which the items were de¬ 
veloped to measure. For this measurement 
model, polychoric correlations “estimate the 
linear relationship between two unobserved 
continuous variables given only observed 
ordinal data”, and these correlations are fit 
in the tested model with Robust Weighted 
Least Squares (WLS), which is a method for 
estimating model parameters using categori¬ 
cal or ordinal data. 19(p467) The measurement 
model was estimated using the software 
package, Mplus. 20 

Robust WLS estimation requires that the 
distribution of ordinal data is not extremely 
skewed or leptokurtotic. Skewed data will 
result in underestimation of the standard 
error of the parameter estimates, which will 
inflate the chi-square model fit test statistic, 
resulting in over rejection of adequately fit 
models. 19 No items were excluded from the 
CFA analysis due to non-normality. Mplus 
procedures accounted for missing data. 

Model Specifications 

The hypothesized measurement model 
(Model 1), created based on the constructs 
of the TPB, contained three factors (latent 
variables representing TPB constructs): Fac¬ 
tor 1-attitude toward school health educa¬ 
tion advocacy, Factor 2-subjective norms 
and Factor 3-perceived behavioral control. 
Refer to Figure 1. 

Fit indices for Model 1 indicated reason¬ 
ably good fit with only the comparative fit 
indices. The chi-square goodness-of-fit (X 2 
= 363.308, df = 52, P < 0.001) was statisti¬ 
cally significant; however, other fit indices 
were analyzed for a better idea of model fit 


and appropriateness. 21 Bender’s 22 compara¬ 
tive fit index (CFI) and TLI 23 were 0.9012 
and 0.9711 respectively. Many researchers 
accept CFI and TLI fit indices greater than 
0.90; therefore, the TLI index in Model 1 
is acceptable. 24 Root Mean Square Error of 
Approximation (RMSEA = 0.1021) is ac¬ 
ceptable at 0.08 and lower, while Standard¬ 
ized Root Mean Square Residual (SRMR = 
0.052) is acceptable at 0.05 or less. 24 Lastly, 
the Weighted Root Mean Square Residual 
(WRMR) was calculated for acceptable rates 
of approximately 1.0. RMSEA (0.1021), 
SRMR (0.052), and WRMR (1.037) did 
not necessarily meet cut-off points; 25 there¬ 
fore, subsequent model testing on a new 
sample would require modifications to the 
measurement model. However, in order to 
preserve the theoretical approach to this 
study and sample, modification specification 
searches were not conducted. According to 
Thompson, 21(p - 131> “respecifying a CFA model 
based on consultation of critical ratio and 
modification index statistics is a dicey busi¬ 
ness, if the same sample is being used to gen¬ 
erate these statistics and then used to test the 
fit of re-specified model.” Additionally, “us¬ 
ing the same sample to re-specify the model, 
and then test the specified model, increases 
capitalization on the sampling error variance 
and decreases the replication of results. And 
using the same sample in this manner also 
turns the analysis into an explanatory one, 
albeit using CFA algorithms.” 21(pl31) 

Parameter estimates and standard error 
for parameter estimates for Model 1 are 
displayed in Table 5. A parameter estimate 
to standard error ratio (Est./S.E.) greater 
than +1.96 or below -1.96 indicates factor 
loading is statistically significant; signifi¬ 
cant path coefficients are noted in Figure 
1 with asterisks. Lastly, Table 1 indicates 
multiple R-square output produced by the 
CFA analysis in Mplus. These values are 
calculated for continuous latent variables 
(underlying continuous variables that are 
not observed) rather than the observed vari¬ 
ables. Multiple R-square values for ordinal or 
categorical outcome variables should not be 
interpreted as the proportion of explained 
variance; therefore, parameter estimates and 
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Figure 1. Confirmatory Factor Analysis Models 


Model 1 for Factor 1 (Attitude) 
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'indicates significant path coefficients (P < 0.05). 
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Figure 1. Confirmatory Factor Analysis Models (con't) 


Model 1 for Factor 2 (Subjective Norms) 


.01 


.43 


.27 


.22 


.69 


.68 


.67 


.04 



.68 


.43 


.37 


.32 


.21 


.68 


.62 


.03 


"These item were preceded by the following directions: Please indicate the degree to which of the following entities are likely to discourage or encourage 
your involvement in school health education advocacy (scale: 1 = very likely to discourage to 5 = very likely to encourage). 

"'Please indicate how likely you are to comply with the desires of each entity (scale: 1 = very unlikely to comply to 5 = very likely to comply). 

'indicates significant path coefficients (P < 0.05). 
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Figure 1. Confirmatory Factor Analysis Models (con't) 


Model 1 for Factor 3 (Perceived Behavioral Control) 


.01 


.67 


.42 
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‘‘These item were preceded by the following directions: Please indicate how much each of the following factors support or hinder your involvement in school 
health education advocacy (scale: 1 = very likely to hinder to 5 = very likely to support). 

‘indicates significant path coefficients (P < 0.05). 


standard errors reveal more about model 
fit and appropriateness than the multiple 
R-square values. 26 

Predictive Validity Measures 

A structural model was created to test 
if the measurement model (Model 1) pre¬ 
dicted students’ intentions to engage in 
advocacy activities (Figure 2). Intentions to 
advocate, due to the activity, were measured 
by five items assessing the likelihood of stu¬ 
dents to engage in the following advocacy 
activities (5-point Likert scale; 1 = very 
unlikely to 5 = very likely): attend a school 
board meeting, use social network plat¬ 
forms for school health education advocacy, 
write a letter/e-mail to the editor regarding 


a school health education advocacy issue, 
meet with a local school board member 
or administrator, and/or write/e-mail a 
legislator regarding a local school health 
education advocacy issue. Additionally, one 
general item assessed students’ intentions to 
increase school health education advocacy, 
as a result of the class activity. 

Fit indices for the structural model 
indicate that the model provides a satis¬ 
factory comparative fit indices for these 
data. The chi-square goodness-of-fit (X 2 = 
464.407, df = 84, P< 0.001) was statistically 
significant. CFI (0.906) and TLI (0.943) are 
acceptable and provide evidence of good 
model fit. Additionally, RMSEA (0.101), 


SRMR (0.062), and WRMR (1.038) were 
borderline acceptable, and therefore indi¬ 
cated that modifications should be made to 
subsequent model tests. It should be noted 
that the instability of the measurement 
model could account for the borderline ac¬ 
ceptable measures here. The authors intend 
to retest the model, after re-specifying the 
model, with a new sample in subsequent 
testing (Figure 2). The standardized path 
coefficients and standard errors of the esti¬ 
mates are provided in Figure 2. Parameter 
estimate to standard error ratios for the 
model reveal that Factor 1 (attitudes toward 
advocacy), Factor 2 (subjective norms), and 
Factor 3 (perceived behavioral control) help 
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Table 1 

Multiple R-square Values for CFA Model 1 

R-square for Items 

Residual Variance 

R-Square 

Item la. 

0.679 

0.321 

Item lb. 

0.690 

0.312 

Item 1c. 

0.315 

0.689 

Item Id. 

0.422 

0.582 

Item le. 

0.568 

0.436 

Item If. 

0.160 

0.850 

Item lg. 

0.055 

0.943 

Item Ih. 

0.639 

0.359 

Item li. 

0.352 

0.646 

Item 2a. 

0.489 

0.507 

Item 2b. 

0.403 

0.593 

Item 2c. 

0.518 

0.461 

Item 2d. 

0.485 

0.513 

Item 2e. 

0.529 

0.467 

Item 2f. 

0.629 

0.373 

Item 2g. 

0.692 

0.304 

Item 2h. 

0.067 

0.960 

Item 3a. 

0.071 

0.930 

Item 3 b. 

0.688 

0.310 

Item 3c. 

0.315 

0.689 

Item 3d. 

0.419 

0.579 

Item 3e. 

0.567 

0.435 

Item 3f. 

0.151 

0.847 

Item 3g. 

0.054 

0.942 

Item 3h. 

0.639 

0.359 

Item 4a. 

0.490 

0.508 

Item 4b. 

0.404 

0.594 

Item 4c. 

0.528 

0.472 

Item 4d. 

0.487 

0.515 

Item 4e. 

0.528 

0.470 

Item 4f. 

0.485 

0.513 


to explain intentions of students to engage 
in school health education advocacy, after 
the advocacy-training lesson. 

Stage 4: A final check 

In this final step of survey development, 
instrument developers ask outside people 
(who have had no part in creating the 
instrument) to review for any final edits. 14 
In the current study, two additional people 
were asked to review the survey for word¬ 
ing or content problems, and as a result, 
no changes were made to the instrument. 
Therefore, the final instrument consists 
of 53 items, measuring intentions of stu¬ 
dents to engage in school health education 
advocacy, as a result of implementing an 
advocacy-training lesson. 

DISCUSSION 

Health educators acknowledge that advo¬ 
cacy promoting quality school health educa¬ 
tion is a critical professional responsibility. 27 
Individuals, beyond health education can 
contribute to local advocacy efforts as well. 2,8 
College students, who are future parents and 
community members, have been overlooked 
as potential advocates for school health edu¬ 
cation. This study resulted in an instrument 
to measure the effectiveness of an advocacy¬ 
training lesson for college students that 
produces reliable scores. Construct validity, 
through additional model testing, needs to 
be conducted after assessment of post-hoc 
modifications. However, this article provides 
methods for testing theoretically-based instru¬ 
ments, and the results will inform subsequent 
studies to test TPB and advocacy intentions. 
An instrument specifically designed to evalu¬ 
ate an advocacy training lesson is a critical tool 
for researchers interested in examining class¬ 
room advocacy activities and the impact of 
those activities on knowledge, intent and skill 
development. Additionally, to strengthen the 
instrument’s reliability and validity it needs 
further use in studies with larger ethnically/ 
racially diverse sample sizes. 

Limitations 

A possible limitation to this study is the 
combining of wave I and II pretest data, 
as the two data sets could reflect differing 


student experiences. Additionally, it should 
be noted that the sample is majority white 
females which limits generalizability of 
results to students of other race/ethnicities 
and opposite gender. The study design is 
non-experimental and all the data is self- 
report data; therefore, researchers were 
unable to assess if data were biased due to 
socially desirable responses. Also, the class 
activity and surveys were administered 
during class times. Although participation 
was not mandatory or linked to class credit, 
100% of students agreed to participate; the 
likelihood of this participation rate in the 
general population is low. Several threats 
to internal validity could interject bias 
with this pre-posttest design, including 


testing threat and memory effect. A limited 
amount of time elapsed between pre- and 
posttest administration, which could ac¬ 
count for any increase in intentions to 
engage in advocacy; however, the purpose 
of this study was to focus on the process 
of instrument development, which can be 
replicated by interested readers, despite 
this limitation. 

Although Ajzen and Fishbein’s TBP 11 as¬ 
serts that behavioral intention is the most 
important determinant of behavior, 12 it 
should be noted that some studies have 
questioned this association in practice. 29 In 
a meta-analyses conducted by Sutton, 29 TBP, 
and the closely-related Theory of Reasoned 
Action (TRA) explain, “on average, between 
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Figure 2. Structural Model for Predicting Intentions to Advocate 


Factors 


Overall Intention to Advocate 



► 


Intentions to engage in 
school health advocacy, 
due to class activity. 


Fit Indices for Final Structure Model: 


f = 464.407, df = 84, P< 0.001 

CFI = 0.906 

TLI = 0.943 

RMSEA= 0.101 

SRMR = 0.062 

WRMR = 1.038 

R 2 = .19 


40% and 50% of the variance of intention, 
and between 19% and 38% of the variance 
in behavior.” 29(pl317) Therefore, there is room 
for improvement in using these models, as 
they exist, for predication of behavior. With 
that said, the use of TBP to predict intentions 
to engage in school health education advo¬ 
cacy should continue to be explored, and in 
subsequent studies, the authors intend to use 
new samples to incorporate varying model 
differences to analyze fit for data based on 
TBP constructs. 


TRANSLATION INTO HEALTH 
EDUCATION PRACTICE 

The process used to develop the theory- 
based instrument to assess college students’ 
intentions to engage in school health educa¬ 
tion advocacy provides direct implications 
for health education practice. First, the 
rigorous instrument development process 
is one that is applicable for the development 
of measurement tools used in an array of 
settings. The framework utilized in this 
project can be replicated by practitioners to 


ensure rigor in developing instruments for 
data collection. In addition, the instrument 
design framework provides an example of 
how theoretical constructs can help guide 
item selection and development. 

Study implications also suggest that prac¬ 
titioners, specifically those in professional 
preparation programs, should consider 
the college student, enrolled in a personal 
health course, as a priority for school health 
education advocacy training. Tappe, Galer- 
Unti, and Radius 28 challenged individuals 
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within the profession to rethink how ad¬ 
vocacy training is promoted and provided 
and the groups to which these trainings are 
offered. The approach taken with this study 
included the overlooked group of students 
enrolled in personal health courses, with 
varying majors and career aspirations, in a 
brief, one-class school health education ad¬ 
vocacy training to test impact on intentions 
to advocate for school health education. The 
researchers urge others in the profession to 
consider this group as one with the potential 
to impact school health education through 
relevant advocacy initiatives, if provided 
adequate training. 

The future of school health education 
will continue to rely on strong voices within 
and beyond the profession to effectively 
engage in school health education advocacy. 
As the need for advocacy-related training 
continues to grow, 28 studies such as this 
can help to provide a solid foundation for 
survey research to provide evaluation data 
to assess effectiveness of advocacy training 
efforts. Additionally, the methodologies used 
in this study can be replicated by others in 
developing valid and reliable tools for data 
collection, as well as, provide a foundation 
for subsequent school health education ad¬ 
vocacy training evaluation studies. 

REFERENCES 

1. Defriese GH, Crossland CL, MacPhail- 
Wilcox B, Sowers JG. Implementing compre¬ 
hensive school health programs: Prospects 
for change in America’s schools. / Sch Health. 
1990;60(4):182-187. 

2. Wiley DC. Elementary school health teach¬ 
ers’ perspectives on health instruction: A com¬ 
mentary. Am JHealth Educ. 2002;33(2):83-85. 

3. Tappe MK, Galer-Unti RA, Radius S. 
Incorporating advocacy training in profes¬ 
sional preparation programs. Am J Health Stud. 
2009;24(l):257-265. 

4. Birch DA. Helping prospective school 
health educators develop political advocacy skills. 
J Sch Health. 1991;61(4):176-177. 


5. Wycoff-Horn MR. Advocacy performance 
task: Learners practice what you teach. Health 
EducMonogr. 2009;26(l):24-28. 

6. Hodges B, Videto D. Service learning: Cre¬ 
ating visibility and advocacy for health education. 
Am J Health Educ. 2008;39(l):44-54. 

7. Birch DA, Wallen M, Chaney BH. Devel¬ 
oping school health education advocacy skills 
through college personal health courses. Health 
Educ Teach Tech J. 2011;1(1):82-101. 

8. Birch DA. Advocacy for comprehensive 
school health education: A survey of pediatri¬ 
cians. American Academy of Pediatrics Newsletter 
of the Section on School Health. 1997; 8(1): 8-9. 

9. Tappe MK, Galer-Unti RA. Health edu¬ 
cators’ role in promoting health literacy and 
advocacy for the 21st century. / Sch Health. 
2001;71:477-482. 

10. McCrary-Quarles AR, Pettit ML, Rahman 
F, Brown SL. Intent to advocate before and after a 
health education workshop. The Health Educator. 
2006;38(2):39-44. 

11. Fishbein M, Ajzen I. Belief, attitude, inten¬ 
tion and behavior: An introduction to theory and 
research. Reading, MA: Addison-Wesley; 1975. 

12. Glanz K, Rimer BK, Viswanath K, eds. 
Health behavior and health education: theory, 
research, and practice. San Francisco, CA: Jossey- 
Bass; 2008:211-230. 

13. American Educational Research As¬ 
sociation, American Psychological Association, 
National Council on Measurement in Education. 
Standards for educational and psychological test¬ 
ing. Washington, D.C.: American Educational 
Research Association; 1999. 

14. Dillman DA. Mail and internet surveys: the 
tailored design method. New York: John Wiley & 
Sons Inc; 2000. 

15. Chaney BH, Eddy JM, Dorman SM, Gless- 
ner L, Green BL, Lara-Alecio R. Development of 
an instrument to assess student opinions of the 
quality of distance education courses. Am J Dist 
Educ. 2009;21(3):145-164. 

16. Gomm R, Needham G, Bullman A, eds. 
Evaluating research in health and social care. 
London: Sage Publications; 2000. 

17. Gagne P, Hancock G. Measurement model 


quality, sample size, and solution propriety in 
confirmatory factor models. Multivariate Behav 
Res. 2006;41(1) 65-83. 

18. SPSS. Predictive Analytic Software (version 
18). Chicago, IL: IBM Company; 2009. 

19. Flora DB, Curran PJ. An empirical evalu¬ 
ation of alternative methods of estimation for 
confirmatory factor analysis with ordinal data. 
Psychol Methods. 2004;9(4):466-491. 

20. Muthen LK, Muthen BO. Mplus user’s 
guide. Los Angeles: Author; 2002. 

21. Thompson B. Exploratory and con¬ 
firmatory factor analysis: Understanding 
concepts and applications. Washington D.C.: 
American Psychological Association; 2004. 

22. Bentler PM. Comparative fit indi¬ 
ces in structural models. Psychol Bull. 
1990;107:238-246. 

23. Tucker LR, Lewis C. A reliability 
coefficient for maximum likelihood factor 
analysis. Psychometrika. 1973;38:1-10. 

24. Heubeck BG, Neill JT. Internal validity 
and reliability of the 30 item Mental Health In¬ 
ventory for Australian Adolescents. Psychol Rep. 
2000;87:431-440. 

25. Potthast MJ. Confirmatory factor 
analysis of ordered categorical variables with 
large models. Br J Math Statistical Psychol. 
1993;46:273-286. 

26. University of Texas, Austin, Infor¬ 
mational Technology Services. Mplus for 
Windows: An introduction. Available at: 
http://www.utexas.edu/its/rc/tutorials/stat/ 
mplus. Accessed on July 28,2010. 

28. Radius SM, Galer-Unti RA, Tappe MK. 
Educating for advocacy: Recommendations 
for professional preparation and development 
based on a needs and capacity assessment of 
health education faculty. Health Promot Pract. 
2009;10:83-91. 

29. Tappe MK, Galer-Unit RA, Radius S. 
Health education faculty’s advocacy-related 
perceptions and participation. Am J Health Stud. 
2007;22(3):186-195. 

30. Sutton S. Predicting and explaining inten¬ 
tions and behavior: How well are we doing. JApp 
SocPsychol. 1998;28:1317-1338. 


American Journal of Health Education — September/October 2011, Volume 42, No. 5 295 



